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Since the Fermi-Pasta-Ulam paradox [1] the question of 
the memory of the initial conditions in a dynamical system 
has been crucial for our understanding of the emergence 
of thermal behavior. The authors' a priori expectation has 
been that for any perturbation away from intergrability, 
no matter how weak, the time evolution in any dynami- 
cal system would erase the memory of the initial values of 
the integrals of motion, and, as a result, would thermal- 
ize in a relaxation process. However, this was not what 
they observed in their numerical experiment. It has been 
later discovered that the transition between the integrable 
and chaotic systems is not at all abrupt; the ability to for- 
get the initial conditions and to thermalize requires that 
the strength of the non-integrable perturbation exceeds a 
certain threshold value [2, 3]. In the intermediate range 
of the interaction strength, dynamical systems are able to 
partially retain the memory; a quantitative treatment of 
this effect in the classical case is provided by the famous 
Kolmogorov-Arnold-Moser theorem (KAM) [4-7]. In this 
article, we present a simple formula that quantifies the ef- 
fect of the memory of initial conditions in a quantum sys- 
tem, weakly perturbed away from the integrable point. 

Two other regimes — strong deviation from integrability and 
the exact integrable point — are already well understood. 

The question on how well observables of an isolated 
quantum-chaotic system can converge to their thermal expec- 
tations by the end of a relaxation from a highly excited ini- 
tial state goes back to the classic 1974 paper by Shnirelman 
[8] and the body of work in mathematics and mathemati- 
cal physics that immediately followed [9-13]. Figuratively 
speaking, here thermalization happens at the level of indi- 
vidual eigenstates of the perturbed system, which are repre- 
sented by large representative quasi-random superpositions of 
the eigenstates of the underlying integrable system. Under 
this scenario, an individual eigenstate is able to emulate the 
microcanonical averaging of the observables over the unper- 
turbed eigenstates. The typical deviation between the mean 
of an observable over an individual eigenstate and its micro- 
canonical value has been linked to physically relevant autocor- 
relation function [14] and studied in many examples [15-19]. 
The vanishing of this deviation in the thermodynamics limit 
(the effect otherwise known as Eigenstate Thermalization) is 
believed to lie at the very foundation of quantum thermody- 
namics [20-22]. Indeed, it determines the maximal possible 
deviation of the infinite time average of the quantum mean of 
the observable of interest from its microcanonical average. A 
direct study of the relaxation process away from integrability, 
both theoretical [22-31] and experimental [32, 33] confirms 
the ability of isolated quantum systems to thermalize. 



On the contrary, completely integrable quantum systems 
have been shown to retain a strong memory of the initial con- 
ditions [28, 29, 34-37]. Here, relaxation is contained within 
individual degrees of freedom leading to a steady state that is 
far from thermal. 

However, only a few results exist on how the memory of the 
initial conditions diminishes as one gradually moves from a 
completely integrable regime towards a well-developed quan- 
tum chaos. These include, first the experimental results [37] 
on the one-dimensional Lieb-Liniger gas [38] perturbed by 
finite-range corrections to the interatomic interaction potential 
and by a tunneling between individual one-dimensional sys- 
tems, and second, the numerical study of the one-dimensional 
integrable bosonic and fermionic lattice models with added 
integrability-breaking next-to-the-nearest-neighbor perturba- 
tion [39, 40]. Our article is an attempt to give a quantita- 
tive description to the effect. The final formula smoothly cov- 
ers the range of strengths of the nonintegrable perturbation 
from the completely integrable limit through the collision- 
less regime where the frequencies governing the individual 
degrees of freedom are still higher than the relaxation rate. 
The formula also assumes the absence of selection rules for 
the perturbation. 

As a concrete example, we consider two short-range- 
interacting bosons in a circular, transversally harmonic 
waveguide [41^-3] far above the transverse excitation thresh- 
old. In many respects the system is similar to the so-called 
Seba billiard [44, 45] — a two-dimensional rectangular box 
with a point scatterer in the middle. In our view, sys- 
tems of this type are ideally suited for the studies on quan- 
tum nonequilibrium dynamics close to the integrable point. 
They do not possess any integrals of motion besides the en- 
ergy, while allowing for an exact analytic solution [44, 46]. 
The integrability-breaking perturbation here is a simple one- 
parametric family of singular potentials with no selection 
rules. It is known that Seba-type systems do show some signa- 
tures of the quantum-chaotic behavior: a gap in the level spac- 
ing distribution and Gaussian statistics for the wavefunction 
in particular. However, at the same time, the tail of the level 
statistics and the momentum distributions in individual eigen- 
states exhibit substantial deviations from the quantum chaos 
predictions [46-50]. 

The results of our study of the waveguide system stand in 
very good agreement with the our general predictions for the 
memory of initial conditions in weakly perturbed integrable 
systems. 

Statement of problem: memory of initial conditions in 
quantum systems weakly perturbed away from integrability. - 
Consider the Hamiltonian of an integrable quantum system 
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under a nonintegrable perturbation V: 

H = H (k) + V , 

where h — {hi, hi, . . . , un} is a complete set of the inte- 
grals of motion, and N is the number of the degrees of free- 
dom. Prepare the system in an initial state |^ ) = \i>(t = 0)) 
and let it evolve. For a generic observable A, the infinite-time 
average of the quantum-mechanical mean is 
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In particular, it describes the mean outcome of the measure- 
ment of the observable A performed at a random time after 
relaxation. Here and below, \ri) and \a) are the eigenstates of 
the unperturbed and perturbed systems, respectively: 

H {k)\n) = E n \n) 
H\a) = E a \a) , 

and Efi and E a are the corresponding eigenenergies. 

The goal of this article is to assess quantitatively the cor- 
relation between the final value of the observable after relax- 
ation and its initial value. 

Assumptions - Three important energy scales are involved 
in the problem: the range of the unperturbed energies ( AE) ^ 
a typical eigenstate \a) of the perturbed system involves, 



(h\a) ^ 



\E n - E a \ < (AE) ]a) ; 



the typical energy distance (AE)a between the states coupled 
by the observable A, 



(n\A\n"') 96 



\E r -E r ,„\ > (AE)a ; 



the typical energy range (AE)^^ covered by the initial state 

l^o), 



|(n|^o)| 2 96 
where 



\En - E^A < (AE)\, M 



E^ = (ip \H (h)\ipo) 

is the energy of the initial state. Note that the first energy 
width (A_E)| Q ) is usually associated of the relaxation rate T 
[24]: 

(A£)| Q) ~r , 
In what follows, we will impose the following assumptions: 



(a) The observable A acts on only one (out of N) degrees 

of freedom. In this case, the energy differences (AE)a 
between different states coupled by A are much greater 
than the inverse density of states. Consistently, we fur- 
ther assume that the energy distance between two eigen- 
states of the underlying integrable system coupled by A 
is typically greater than the range of energies spanned 
by a typical eigenstate \ot) of the full system, 

[AE) W) « (AE) A . 

A system whose parameters obey the above inequality 
is usually said to be in the collisionless regime where 
the dephasing of individual degrees of freedom is faster 
than the relaxation rate V <~ (AE)\ a y 

(b) The sequence (h\a) of the coefficients of the decompo- 

sition of a given perturbed eigenstate \a) over the un- 
perturbed eigenstates |n) show quasi-random behavior. 
Traditionally, this property is modeled using ensembles 
of random Hamiltonians [51]. In this spirit, we assume 
that the matrix of the matrix elements (n\V\n') of the 
perturbation V is realizations of a Gaussian ensemble 
of random matrices [52], where the second moments 
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(n\V\n' ^ n) 



V 



do not depend on the states h and n'. Here, g = 2 (g = 
1) for the Gaussian Orthogonal(Unitary) Ensemble. 

Under the above assumptions, the average value of the observ- 
able after relaxation (1) becomes 

J2v(En)\{n\i>o)\ 2 (n\A\n) . (2) 

n 

(See Eq. (5) for the rationale behind the singling out of the 
diagonal contribution.) Above, the terms with h 1 " ^ h are 
eliminated from the right hand side of the Eq. (1) under the 
assumption (a). The assumption (b) eliminates the n" ^ h'. 
Here 



F(E ri , ^) = El^l a )| 2 |^'l a ) 



is the so-called overlap function similar to the one appear- 
ing in the treatment of the embedded Gaussian models of 
EGOE(l+2) type [24, 51], and 



(3) 



is the so-called inverse participation ratio, the inverse of 
which is often called the number of the principal components 
(see [25] for a review). Note that usually the object of interest 
is the inverse participation of the perturbed eigenstates over 
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the unperturbed ones: ; it has the same spectral 

average as r/^-j). Note that both F{E n , E^) and r/(i^) 
above are functions of energies only and are insensitive to the 
properties of the states \n). It can be shown that this feature 
guaranteed by the assumption (b). 
We will further assume that 

(c) F(Eft, Ef{i) is a slow function of the two energies that 

does not change substantially on the scale of a typical 
energy spacing between the levels. 

For example, for the EGOE(l+2)-type models and in the case 
of a weak perturbation, the overlap function has the form 

F(E E') = - ^ 

(see [24]). Here, pe is the density of states, and V ~ (AE)\ a ) 
is the so-called spreading width. 
Next, we are going to assume that 

(d) the energy range spanned by the initial state (AE)^ is 

much narrower than any energy scale over which any 
macroscopic property of the unperturbed system can 
change; 

(e) within a microcanonical window E^ — AE < E < 

E^ a + AE (that includes the energy range (AEjua) 
the energy-ordered sequence of the unperturbed eigen- 
states {|r? s )} (s' > s E r i > E r i ) can be modeled by 
a random sequence of the eigenstates, {|n s )} with one 
realization being statistically independent of another: 

Prob[(n s =n)&(tv 

Prob[n s = n] Prob[n s , = ft'] . 

The probabilities of the individual events are numeri- 
cally equal to the diagonal matrix elements of the mi- 
crocanonical density matrix: 



part whose statistical properties are approximately uni- 
form over the microcanonical window W: 



Prob[n s = n] = pucE^in) 



Here, 



PMC.E^An) = 



p for E n g [E^ - AE, E^ + AE] 
otherwise 



where AE defines a suitable microcanonical window W = 
[E^ - AE, E^ + AE];p = TV -1 ; TV = £™ 1 is the num- 
ber of states inside the window; Y^n ■ ■ ■ denotes a sum over 
the window, J2a- _E-ew ■ ■ - ^he assumption (e) is rooted in 
the observation that for integrable systems with incommen- 
surate frequencies, neighboring eigenstates typically show no 
correlation between the respective sets of quantum numbers. 

Consider now the first sum on the right hand side of Eq. (2). 
We factorize each initial state component | (n'\ipo) 1 2 into a 
slow envelope cr(Eff) of width (AE)^^ and a fluctuating 



with yvc^o = 1 



and £(n') = 1 . 

Now, according to the assumption (e), we replace the indices 
n s in the fluctuating, energy-independent functions of n s , 
£(n s ) and (n s \A\n s ), by events in a random sequence {n s }: 

E E F(En,E, v )\(ri'^o)\ 2 (n\A\n) 

n n'^n 

W W 

-EE HEn, En>) \(n' \^o)f (n\A\n) (4) 
^EE F ( E *.> E Hs ,)a(En'nn')(rt s \A\n s ) . 

s s'^s 

(Notice that according to the assumption (c), F(E iis , E^ a , ) 
is treated as a slow function of two energies.) Averaging over 
many realizations of the sequences {|n s )} yields 

E E HE*., E n .ME*)m'Ws\M*,) 

s s'^s 
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= E E F ( E *.> ^X^K(fi') (n s \A\n s ) 

s s't^s 
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w w 

= E E F ( E *> E rV )a(E H ,) (5) 

ft n'^n 

~ ^2 F(Efii En')&{En') ^therm. 

ft n'^ri 

= (l-rf) Aherm. , 



where 



Itherm. 



1 W 

xtE^i^I") 



n 

= ^2pMC,E<, (n)(n\A\n) (6) 

ft 

is the microcanonical expectation value of the observable, 

If = J2°(En>MEfi>) (7) 

n' 

is the average of the inverse participation ratio over the slow 
envelope a(Eft), and in the last step in the chain (5) the cor- 
rections appearing when n is close to the edge of the micro- 
canonical window are neglected. The product £(n') (n s | A|n s ) 
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is factorized according to the assumption (e). Note that such 
a factorization is justified only when the s-th event n s and the 
s'-th event tv are two separate events, i.e. when s ^ s'. This 
distinction justifies the singling out of the diagonal terms in 
Eq.(2). 

The first sum in the Eq. (4) constitutes an unbiased single- 
realization approximant for the final expression in the chain 
(5). Accordingly, the Eq. (2) becomes 

Aelax. Aherm., approx. ~ (8) 
V(En) | (n|Vo) I' {n\A\n) - If Ahem, , approx. ; 

n 



where 



Aherm., approx. — ^ ] Kf L (n\A\n) 



(9) 



is an unbiased single-realization approximant for the micro- 
canonical average (6) and 

where ^ = 1 . 

n 

For a sufficiently large window spanned by the initial 
state ((AE)\^ )) the discrepancy between the approximant 
Aherm., approx. and the true thermal average Aherm. i s sma H- It 
can be shown that the discrepancy typically scales as the in- 
verse square root of the width of the window: | Aherm., approx. — 

Aherm. | « 1/ y/(AE) m . 

Let us now introduce the final assumption stating that 

(f) the eigenstate-by-eigenstate fluctuations of the inverse 
participation ratio fy(£W) are much lower than its run- 
ning average, and its running average does not change 
substantially inside the energy interval covered by the 
initial state, (AE)^ y Consequently, the inverse par- 
ticipation ratio ri(Ef{) entering the relationship (8) and 
the definition (7) can be approximately replaced by its 
microcanonical average rj w : 



V (E) « rj 



■w 



where 



(10) 



is the microcanonical average of the inverse participation ra- 
tio. The assumption (f) brings us to the central result of this 
article. 

The central result and its interpretation - We arrive at the 
central result of this article: 
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where the approximant Aherm., approx. to the microcanonical av- 
erage (6) is given by the expression (9), the average inverse 
participation ratio is represented by the expression (10), and 
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J2\(n^o)\ 2 (n\A\n) 



is the noninteracting diagonal average of the observable over 
the initial state: it equals to the time average of the quantum- 
mechanical mean of the observable in a (fictitious) time evo- 
lution governed by the unperturbed Hamiltonian alone. It de- 
termines the temporal average for the observable at the initial, 
integrable stage of the relaxation process. 

The physical meaning of the formula (11) is transparent. 
For a weak deviation from integrability, the loss of memory 
of initial conditions is a two-stage process. As it has been 
mentioned above, at the initial stage of the relaxation the loss 
of memory is not related to the perturbation at all: it is merely 
a result of the equilibration within each degree of freedom 
separately. This interpretation is consistent with the assump- 
tion (a) above: for example, in the EGOE(l+2)-type models 
the energy width (AE)\ a } is associated with the relaxation 
rate T [24] and thus the assumption (a) simply states that the 
relaxation time is much longer than the period of the initial 
integrable equilibration. At the later stages, each unperturbed 
component \n') of the initial state gets transformed into an 
incoherent superposition of the perturbed eigenstates \a). A 
given component \n') of |^o) has a weight of the order of rj in 
a typical perturbed eigenstate \a); the rest of the components 
are indiscriminately drawn from a microcanonical shell and 
do not participate in the memory retention (see Fig. 1). The 
combination of the two effects leads to the expression (1 1). 

A particular example: two bosons in a multi-mode 
waveguide - Below, we are going to test our predictions on 
a simple model. Consider the relative motion of two short- 
range-interacting bosons in a circular, transversally harmonic 
waveguide. The analogous model involving a linear waveg- 
uide has been previously studied in [41]. The Hamiltonian of 
the system 



2fi dz 2 ~ 2p 



H = - — — - —A p + U + V-huj ± 



(12) 
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is a sum of the longitudinal and transverse kinetic en- 
ergies, the transverse trapping energy U = H^\p 2 1 2, 
and the Fermi-Huang-type interaction that couples the 
transverse and longitudinal degrees of freedom, V = 
(2ith 2 a e i/ Li)dz{r){d/dr){r ■). Here uj± is the transverse 
frequency, A p is the transverse two-dimensional Laplacian, 
/i = m/2 is the reduced mass, m is the atomic mass, and 
a s is the three-dimensional s-wave scattering length. We 
will assume periodic boundary conditions along z, with a pe- 
riod L. In what follows, we will restrict the Hilbert space 
to the states of zero z-component of the angular momentum 
that are also even under the z <-> — z reflection. Note that 
the zero-range interaction has no effect on the rest of the 
Hilbert space. The non-interacting eigenstates are products of 
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FIG. 1 : An symbolic illustration of the main result. Here we show 
a particular example of a two-dimensional system, where a typical 
eigenstate of the perturbed system involves four eigenstates of the 
unperturbed integrable system. The state |a) includes the initial state 
as one of the four components. The initial state constitutes a large 
improbable fluctuation, which leads to large deviations between the 
observed and thermal values of the observables. However, the rela- 
tive weight of this fluctuation in the perturbed eigenstate is reduced 
by a factor of r\ ~ 1 /4, where r\ is the inverse participation ratio. 
The remaining three states are in effect drawn indiscriminately from 
the microcanonical shell of width (A£)| a ). 



the transverse two-dimensional zero-angular-momentum har- 
monic wavefunctions, labeled by the quantum number n > 0, 
and the symmetric plane waves cos(2irlz/ L), I > 0. The un- 
perturbed spectrum is therefore given by 



E nl = 2huj ± n + h 2 {2nl/L) 2 /{2i±) 



(13) 



Even though the perturbation V destroys the complete set of 
integrals of motion of the unperturbed system, the separable 
nature of the interaction allows to solve the problem exactly. 
The details of our calculations will be published elsewhere 
[46]. Solutions of this type were first obtained in Refs. [44, 
45] for the Seba billiard — a two-dimensional rectangular box 
with a point scatterer in the middle — and its generalizations. 

Our primary observable of interest is the transverse trap- 
ping energy U. For a given energy E^ of the initial state the 
allowed values of U span the range between and E^ . The 
noninteracting diagonal average over the initial state is more 
restricted, 

< (£/i n it.)NID — ; 

due to the equipartition between the transverse kinetic and 
transverse trapping energies in the noninteracting system. In 
thermal equilibrium one would expect an equipartition be- 
tween the three parts of the Hamiltonian (12), leading to 
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FIG. 2: Memory of initial conditions for two bosons in a waveg- 
uide. The final deviation of the transverse trapping energy from its 
thermal value as a function of the initial deviation for two interact- 
ing bosons in circular harmonic waveguide. Two distinct trajecto- 
ries in the space of initial states are shown, both spanning the whole 
available range for the initial deviation: here, squares correspond 
to the trajectory (14) and crosses correspond to the trajectory (15). 
For all the points the initial energy was fixed to E^, ~ 205hui± 
and the ratio between the longitudinal and transverse lengthscales 
to (irL/a±) 2 = 24> gr 7v 5 ~ 990.3. Two values of the interaction 
strength are analyzed, one (a e ; = 10 6 ) corresponding to a virtually 
infinitely strong interaction, and another (a e ; = 10~ 2 ) to a weak in- 
teraction. The solid lines show the prediction of the general formula 
(11). For both values of the scattering length, the inverse participa- 
tion ratio r\ used in the formula (11) was computed as an average 
over all the states of the noninteracting system belonging to the en- 
ergy interval E^, ± 10hu}±. The thermal prediction corresponds to 
a microcanonical average over a similar window. Note that no aver- 
aging of the results over random Hamiltonians has been performed. 



At rational values of the parameter (ttL/(i±) 2 the energy 
spectrum (13) shows degeneracies. To avoid the degenera- 
cies we fix it to a highly irrational number: (irL/a±) 2 = 
20 gr 7r 5 w 990.3, where 4> gr — (1 + y/E)/2 is the golden 
ratio. 

In all calculations, the energy of the initial state was fixed 
to E$ w 205/kjx- 

We have investigated two distinct paths in the space of ini- 
tial states. In both cases the initial wavepacket is a product 
of a transverse and a longitudinal state. In the first case, the 
transverse state is a transverse eigenstate \n p ), while the lon- 
gitudinal one is represented by two wave packets moving in 
mutually opposite directions and initially localized at the point 
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opposite to the scatterer: 



(z\ipo) = const x \n p ) x cos(2p (z - L/2)/h) x 
cos(irz/(dL)), \z-L/2\<dL\ 







otherwise 



The surface of constant energy E$ was explored along the 
line of constant width of the wavepackets fixed to d = 0.1, 
while the parameters n and p were scanned. In the second 
case, the distribution of the transverse integral of motion n p is 
chosen to be broad. The initial state had a form 



(p, z|^>o) = const x cxp(— np 2 /a 2 L ) x 

cos(7rz/(dL)) , |^-L/2|<rfL 







otherwise 



(15) 



This time, we were scanning the widths of the transverse and 
longitudinal wavepackets, 1/n and d. 

Figure 2 shows a good agreement with the general predic- 
tion in Eq. (11), for both strong and weak interactions. Unlike 
in the general model, no ensemble average over different per- 
turbations was performed. 

Notice also a peculiarity of the systems with separable in- 
teraction, including the present model and the Seba-type bil- 
liards: even for infinitely strong interactions, the inverse par- 
ticipation ratio i] never falls below approximately 1/3. Using 
the prediction in Eq. (11) one can say that in these systems 
the initial deviation from the thermal equilibrium can never 
be healed completely; the observable will stay away from the 
thermal prediction by at least 1/3 of the initial deviation. 

Summary and outlook- In this article we suggest a simple 
law governing the effect of the loss of memory of initial condi- 
tions in an integrable system weakly perturbed away from the 
integrable point. The law assumes the "collisionless regime" 
where the period of oscillation for individual degrees of free- 
dom is much shorter than the relaxation time. Another as- 
sumption was that the perturbation is not constrained by any 
selection rules. Our findings are confirmed by the results of 
an ab initio study of two short-range-interacting bosonic par- 
ticles in a circular, transversally harmonic waveguide in the 
multi-mode regime. 

We believe that our results can be extended beyond the col- 
lisionless regime. In this case, the noninteracting diagonal av- 
erage over the initial state in Eq. (1 1) is likely to be replaced 
by the true initial value of the observable. On the other hand, 
we think that the weakest point of our model is most likely 
the assumption of the absence of selection rules, which are 
present in any many-body system. It remains to be proven 
that the selection rules do not introduce a systematic bias in 
the approximant of Eq. (9) for the thermal expectation values 
of the one-degree-of-freedom observables of interest. 
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